Skip to content

Include score summary and submission ID in Slack notifications#1

Merged
olearycrew merged 1 commit intomainfrom
scuttlebot/slack-score-summary
Mar 12, 2026
Merged

Include score summary and submission ID in Slack notifications#1
olearycrew merged 1 commit intomainfrom
scuttlebot/slack-score-summary

Conversation

@ScuttleBot
Copy link

Parses the new benchmark.py output to extract:

  • Final score (e.g., 8.50/10 (85.0%))
  • Submission ID (UUID)
  • Leaderboard URL

Results section in Slack now shows:

Results:
 • model-name: 8.50/10 (85.0%) — https://pinchbench.com/... (submission: uuid)

Depends on: pinchbench/skill#36 (adds the log lines to parse)

Parses the new benchmark.py output to extract:
- Final score (e.g., 8.50/10 (85.0%))
- Submission ID (UUID)
- Leaderboard URL

Results section now shows:
 • model-name: 8.50/10 (85.0%) — https://pinchbench.com/... (submission: uuid)
@kilo-code-bot
Copy link

kilo-code-bot bot commented Mar 9, 2026

Code Review Summary

Status: No Issues Found | Recommendation: Merge

Files Reviewed (1 file)
  • bench_runner.sh — Extracts score, submission ID, and leaderboard URL from model output; builds richer Slack notification entries. All variables properly quoted, || true guards in place for set -e safety. Clean, low-risk change.

@olearycrew olearycrew merged commit 9c781cf into main Mar 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants